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METHOD AND APPARATUS FOR USING DVD SUBPICTURE INFORMATION 

IN A TELEVISION RECEIVER 

5 BACKGROUND OF THE DISCLOSURE 

1. Field of the Invention 

The present invention relates to an apparatus and 
method for processing video signals, and more specifically, 
to an apparatus and a method for processing digital video 
10 disk (DVD) subpicture formatted information within a 
television signal . 

2. Description of the Background Art 

Most digital satellite, digital cable television 
set top boxes and digital over-the-air television receivers 

15 decode moving pictures experts group (MPEG) -compliant 
signals, ISO/IEC International Standards 11172 (1991) 
(generally referred to as MPEG-1) and 13818 (1995) 
(generally referred to as MPEG-2) , to recover audio and 
video information therefrom. These signals comprise 

20 encoded bitstreams containing coded representations of a 
plurality of images, and audio and control information 
associated with the images. The bitstreams are generated 
by an encoder system and' transmitted to a decoding system 
through a communications channel. 

25 In addition to audio and video information, an 

MPEG-compliant signal is capable of carrying data services 
on a data service channel such that the receiver can 
display stock prices, weather information, sports scores, 
electronic program guide information, top news stories and 

30 the like. This data channel information is presented using 
the on-screen display (OSD) functions of the MPEG decoder. 

However, the OSD functionality of an MPEG decoder 
has a very limited capability to display graphics. The 
data service channel is generally limited to the display of 

35 text information that scrolls along the bottom of a video 
image. As such, non-text information such as complex 
graphics or animation generally cannot be decoded and 
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displayed using the OSD functions of the MPEG decoder. 
Also, MPEG-based graphics do not facilitate interactivity 
with a viewer. 

Therefore, there is a need in the art for a 
method and apparatus for transmitting, decoding and 
displaying data channel information in a format that 
permits enhanced graphics functionality as compared to a 
graphics display system based on an MPEG decoder. 

SUMMARY OF THE INVENTION 

The invention provides a method and apparatus for 
using DVD subpicture formatted information within a MPEG 
data stream to provide data channel information to a 
television receiver or other device that uses an MPEG and 
DVD transport mechanism. One or more DVD subpicture 
bitstreams are combined with the MPEG bitstream and 
transmitted by a transmitter, and is processed by a DVD 
subpicture decoder in the receiving system. 

An aspect of the invention provides a receiver 
(including television receivers, Institute of Electrical 
and Electronic Engineers (IEEE) standard 1394 digital 
interface or Universal Serial Bus (USB) digital interface) 
having a MPEG decoder and a DVD subpicture processor (also 
referred to as a DVD subpicture decoder) . A transport unit 
parses and routes the MPEG data packets to a MPEG decoder 
and the DVD subpicture packets to a DVD subpicture decoder. 
The MPEG decoder generates a signal associated with the 
video program and the DVD subpicture decoder generates a 
signal associated with a graphics display that can be \ 
overlayed on the video program. 

The DVD subpicture bitstream may be used to 
transmit and display data channel information such as stock 
quotes, electronic program guide information, advertisement 
information, and the like. The DVD subpicture information 
is also capable of supporting interactive functions. DVD 
subpicture information is designed to allow a user to 
interact with a DVD disk and select from a menu any 
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locations or scene on a disk through sector addressing. In 
the DVD subpicture transmission application, the menu 
functionality is used to select different portions of the 
data channel DVD subpicture bitstream for display or to 
5 cause the receiver to select another stream of video in an 
interactive manner . 

BRIEF DESCRIPTION OF THE DRAWINGS 
The present invention is described with reference 
10 to the accompanying drawings, wherein: 

FIG. 1 depicts a block diagram of a digital video 
receiver system; 

FIG. 2 depicts a string of packets corresponding 
to a plurality of programs and their associated video, 
15 audio and data packets; 

FIG. 3 depicts a television display showing 
information recovered from a DVD formatted subpicture 
information; and 

FIG. 4 depicts a flow diagram of a method of 
20 processing DVD subpicture information extracted from a MPEG 
data stream. 

To facilitate understanding, common reference 
numerals have been used to designate elements that are 
common to the figures. 

25 

DETAILED DESCRIPTION 
Fig. 1 illustrates a digital satellite receiver 
system suitable for receiving and decoding a bitstream 
comprising MPEG and DVD subpicture bitstreams in accordance 

30 with the present invention. The satellite television 

system shown in Figure 1 is a digital television system in 
which television information is transmitted in compressed 
form in accordance with a predetermined digital compression 
standard such as MPEG-2. It is to be understood that the 

35 present invention may be implemented in any video signal 

processing system capable of receiving and decoding digital 
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video signals for display, including those that receive the 
signals off the air or via cable systems. 

A representation of a typical data stream 
processed by receiver system 15 is illustrated in Fig. 2. 
5 As shown in Fig. 2, the data stream includes a string of 
data packets that represent a plurality of video programs. 
The data packets are encoded, multiplexed and transmitted 
from transmitter 1. Packets with letters having like 
subscripts represent components of a single television 

10 program. For example, the packets identified as VI, Al and 
Dl represent video, audio and data for program 1. in the 
upper line of the string of packets, the respective 
components of a particular program are shown grouped 
together. However, it is not necessary to group components 

15 of a particular program together, as indicated by the 
packet sequence in the middle of the string. Moreover, 
there is no requirement to place the packets of string in 
any particular order. 

Each of the packets includes a header portion, 

20 which includes the program identifier (PID) and various 

control information, and a payload portion, which contains 
the actual information to be processed and displayed. In 
the present invention, the string includes data packets 
that include DVD subpicture information in the payload 

25 portion. The packets having DVD subpicture information are 
identified and associated with a particular program using 
respective PIDs. 

The analog video and audio signals are converted 
to respective digital signals and encoded within 

30 transmitter 1. Also, forward error correction (FEC) data 
is added to the packets in order make the correction of 
errors due to noise within the transmission path possible. 
The well known Viterbi and Reed-Solomon types of forward 
error correction coding may both be advantageously 

35 employed. The digital information resulting from the 

compression, encoding and error correction operations is 
modulated on a carrier in what is known in the digital 
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transmission field as QPSK (Quaternary Phase Shift Keying) 
modulation . 

In the system shown in Figure 1, transmitter l, 
with associated transmitting antenna 3, transmits 
5 television signals including video and audio components to 
satellite 5 in geosynchronous earth orbit. Satellite 5 
receives the television signals transmitted by transmitter 
1 and retransmits them toward the earth. The television 
signals transmitted by satellite 5 are received by antenna 

10 assembly or "outdoor unit" 7. Antenna assembly 7 includes 
antenna 9 and a frequency converter 11. Antenna 9 directs 
the television signals transmitted from satellite 5 to 
frequency converter 11, which converts the frequencies of 
all the received television signals to respective lower 

15 frequencies . 

The television signals produced by frequency 
converter 11 are coupled via coaxial cable 13 to satellite 
receiver 15. Satellite receiver 15 tunes, demodulates and 
otherwise processes the received television signal to 

20 produce video and audio signals in a format (NTSC, PAL or 
SECAM) suitable for processing by conventional television 
receiver 17 to which they are coupled. Television receiver 
17 produces an image on display screen 19 in response to 
the video signals and an audible response by means of 

25 speakers 21a and 21b in response to the audio signals. 

Satellite receiver 15 includes a tuner 1501 with 
a local oscillator and mixer (not shown) for selecting the 
appropriate carrier signal from the plurality of signals 
received from antenna assembly 7 and for converting the 

30 frequency of the selected carrier to a lower frequency to 
produce an intermediate frequency (IF) signal. The IF 
signal is demodulated by a QPSK demodulator 1503 to produce 
a demodulated digital signal. FEC decoder 1505 decodes the 
error correction data contained in the demodulated digital 

35 signal, and based on the error correction data corrects the 
demodulated packets representing video, audio and other 
information. For example, FEC decoder 15 05 may operate 
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according to Viterbi and Reed-Solomon error correction 
algorithms when Viterbi and Reed-Solomon error correction 
encoding is employed in transmitter 1. Tuner 1501, QPSK 
demodulator 1503 and FEC decoder 1505 may be included in a 
5 unit available from Hughes Network Systems of Germantown, 
Maryland or from Comstream Corp., San Diego, California. 

Transport unit 1507 is a demultiplexer which 
routes the video packets of the error corrected signal to a 
video decoder 1509, DVD subpicture data packets to DVD 

10 subpicture decoder 1514 and the audio packets to an audio 
decoder 1511 via a data bus according to the header 
information contained in the packets. Video decoder 1509 
cooperates with a random access memory (RAM) 1513 for 
example, in the form of a dynamic RAM (DRAM) , to decode and 

15 decompress the video packets in accordance with MPEG- 2 to 
form a stream or sequence of digital words representing 
respective luminance (Y) and color difference (U and V) 
components. Video decoder 1509 may be incorporated in a 
single integrated circuit (IC) . Suitable video decoding 

20 and decompression ICs are commercially available and well 
known to those skilled in the art. For example, a MPEG 
decoding and decompression IC, identified by part number 
ST3240, is available from SGS Thomson, of France. 

The sequence of video component representative 

25 digital words is coupled to a television encoder 1515 which 
converts the component representative digital words to a 
sequence of digital words representing luminance (Y) 
information and a sequence of digital words representing 
chrominance (C) information in accordance with the line and 

30 field raster scanning format of a conventional television 
standard such a NTSC, PAL or SECAM. Television signal 
encoder 1515 generates line (H) and field (V) rate signals 
and a picture element (pixel) clock signal (P) which are 
coupled to video decoder 150 9 to synchronize the component 

35 representative sequence of digital words. The luminance 
and chrominance representative digital words are converted 
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to analog luminance and chrominance signals by respective 
sections of a digital-to-analog converter (DAC) 1517. 

Audio decoder 1511 decodes and decompresses the 
audio packets and the resultant digital audio signal is 
5 converted to a baseband analog audio signal by a DAC 1519. 
Although only a single audio channel is indicated in Figure 
1, it will be appreciated that in practice one or more 
additional audio channels, for example, for stereophonic 
reproduction, may be provided as is indicated by speakers 
10 21a and 21b. 

The baseband analog video and audio signals are 
coupled to television receiver 17 via respective baseband 
connections. The baseband analog video and audio signals 
are also coupled to a modulator 1521 which modulates the 

15 analog signals on to a radio frequency (RF) carrier in 

accordance with a conventional television standard such as 
NTSC, PAL or SECAM for coupling to the antenna input of a 
television receiver without baseband inputs. 

Microprocessor 1523 performs various control 

20 functions, including, but not limited to, providing 
frequency selection control data to tuner 1501 for 
controlling the operation of tuner 1501 to tune channels 
selected by the user, providing control data to video 
decoder 1509, DVD subpicture decoder 1514 and audio decoder 

25 1511, and managing access to memory and controlling the 
display of the decoded images. Although the present 
invention describes a single microprocessor, those skilled 
in the art will realize that microprocessor 1523 may 
comprise various dedicated devices to manage specific 

30 functions, e.g., a memory controller, a microprocessor 
interface unit, and the like. 

Microprocessor 1523 may generate, in the 
conventionally known manner, using graphics information 
included in the MPEG bitstream, control data for causing 

35 graphics images, such as alphanumeric characters and/or 
pictorial graphics, for example, representing status 
information and operating instructions, to be displayed on 
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screen 19 of television receiver 21. The graphics data 
specifies the color and position of each picture element 
(pixel) of the graphics that are to be displayed. The 
graphics data represents a pixel by pixel map or "bit map" 
5 of the graphic image. 

Advantageously, an on screen display (OSD) 
arrangement is integrally incorporated in video decoder 
1509 and associated video RAM 1513, which are primarily 
used for the decoding and decompression of the video data 

10 packets. The graphics data is coupled to video decoder 

1509 via the control bus. As a result of the shared use of 
video decoder 1509 and associated video RAM 1513, a 
separate OSD arrangement is not needed. 

The OSD portion of video decoder 1509 includes an 

15 OSD controller that cooperates with an OSD section of video 
RAM 1513. The graphics representative bit map generated by 
microprocessor 1523 is coupled to the OSD section of RAM 
1513 for storage. For each pixel of the graphic image 
there is a digital word representing a color for that 

20 pixel. The number of bits contained in the color 

representative digital words determines how many different 
colors each pixel can have. The OSD display unit in video 
decoder 1509 causes the bit map to be read out from the OSD 
section of RAM 1513, and converts the color representative 

25 word for each pixel to the corresponding component 
representative group from the header. 

Typically, when the OSD function is enabled for a 
particular image or frame, microprocessor 1523 manipulates 
the data in memory 1513 to construct an OSD bitstream 

30 containing a header and data defining the OSD pixels. 
However, those skilled in the art will realize that the 
order of constructing and retrieving the OSD bitstream can 
be modified in a number of ways. For example, the OSD 
header can be read from the memory as microprocessor 1523 

35 is formatting the OSD data, or the OSD data can be 

processed and displayed as OSD messages by a separate OSD 
unit without having to retrieve the entire OSD bitstream. 
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Conventionally, the video and OSD are displayed 
in one of at least three different modes. In a video image 
only mode of operation, an output multiplexer (not shown) 
of video decoder 1509 selects only the video image groups. 
In a graphic image only mode of operation, the output 
multiplexer selects only the graphic image groups. In a 
"superimpose" mode of operation, in which the graphic image 
is inserted within a video image, the output multiplexer 
selects either the video image groups or the graphic image 
groups on a pixel by pixel basis. 

According to the present invention, receiver 15 
can also provide graphics images based on DVD subpicture 
data packets included with the MPEG bitstream. The DVD .... 
subpicture information is inserted into the MPEG bitstream 
at transmitter 1 by using a predetermined picture 
identification (PID) for the DVD subpicture information. 
The DVD subpicture bitstream comprises run length encoded 
bit maps that are compressed in accordance with the run- 
length compression rules specified in the DVD specification 
part 3. The bit maps can be overlayed atop the MPEG 
reconstructed video. The DVD subpicture information can 
comprise up to 32 subpicture bitstreams. The DVD 
subpicture bitstream is decoded by DVD subpicture decoder 
1514 to generate a signal that corresponds to a graphics 
image, which image is coupled to video decoder 1509. Video 
decoder 1509 combines the DVD subpicture graphics signal 
with the MPEG video signal in one of a video only, graphics 
only or superimpose mode to generate the output display. 

The user may select one program to display as an 
audio-video program while a data channel program is 
simultaneously processed and overlayed using DVD subpicture 
processor 1514. For example, a user may select a program 
to display while, at the same time requesting that stock 
quotes be displayed on the bottom of the video display. 
The stock quotes are encoded as a DVD subpicture bitstream 
having a predetermined PID, and combined and transmitted 
with the video program bitstream. When the bitstream is 
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received, video decoder 1509 decodes the program 
information for display, while the DVD subpicture bitstream 
is decoded by DVD subpicture processor 1514 for overlaying 
a graphic image onto the program display. 

Applications for DVD subpicture formatted 
information include menu structures, subtitles, karaoke, 
and simple animation as well as MPEG still pictures. This 
information is formatted as part-or full-screen bitmaps 
having four pixel values. The pixels within a subpicture 
bitmap are divided into four types that include background, 
foreground, emphasis-1 and emphasis-2. The four pixel 
types are represented by two-bits. The subpicture 
information uses four colors out of a sixteen color palette 
and four contrast values out of sixteen available contrast 
values. The subpicture format enables the area, content, 
color and contrast of the subpicture region to be changed 
with every video field. 

A subpicture display control sequence controls 
the presentation of each of the subpictures. The 
subpictures include presentation effects such as scrolling 
up and down, subpicture location changes, fading in and 
out, scrolling left and right, transparency changes and the 
like. 

The subpicture formatted information is carried 
in a packet (also known as a "unit structure") having a 
subpicture header (SPUH) , pixel data (PXD) and a display 
control sequence table (SP_DCSQT) . The display control 
sequence table carries a plurality of display control 
sequences. Each display control sequence comprises a start 
time, a pointer to the next display control sequence, and a 
command sequence. A command sequence is a plurality of 
commands including set start address in the display 
picture, set colors, set contrast, set subpicture screen 
position, and set the start and stop display. As such, the 
subpicture display formatted information can be controlled 
to be displayed anywhere on the screen. Also as multiple 
subpicture bitstreams may be transmitted (up to 32) , 
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multiple, displays can be included in the output display and 
the subpicture displays can also be layered to provide 
menuing capabilities . 

FIG. 2 is an exemplary display 200 of the use of 
5 DVD formatted information from a plurality of subpicture 
bitstreams. One DVD bitstream can be used for displaying 
stock quotes in a banner 200 along the bottom of the screen 
while another bitstream can be used for carrying an 
advertisement banner 206 comprising MPEG still information. 
10 One or more DVD subpicture formatted bitstreams can be used 
for carrying program guide information 204. The program 
guide information is interactive such that hot regions 2 08 
are displayed using the highlighting function (emphasis -1 
and/or emphasis-2) of the DVD subpicture format such that a 
15 user may "browse" a region in the program guide and have 
the subpicture processor highlight the region. Once the 
highlighted region is "selected" (i.e., depressing a select 
key on a remote control device while the region is 
highlighted) , the receiver may either select another 
20 program guide page for display, select some other DVD 

subpicture information or map that region to a new channel 
to be tuned and displayed. As such, the user can select a 
/channel for display directly from the program guide and 
have the tuner automatically tune to that channel. 
25 For further functionality of the DVD formatted 

subpicture information, the entire DVD subpicture bitstream 
can be decoded and stored in frame buffer 1516 such that 
the user can interactively change to one of the other 
decoded and stored bitstreams or any location within a 
30 bitstream for display. As such, a fully interactive 
program guide or other data channel information can be 
supplied to the user. To limit the size of frame buffer 
1516, portions of the DVD subpicture bitstreams are decoded 
and stored in frame buffer 1516 while the remainder can be 
35 demodulated and decoded as needed. To facilitate this 
decoding with a reasonable decoding latency, the DVD 
subpicture bitstreams repeat within the MPEG stream on a 
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regular basis. The decoding process will be further 
described with respect to Figure 3. 

FIG. 3 depicts a flow diagram of the operation of 
the present invention. The method 300 begins at step 302 
by receiving a MPEG compliant bitstream. The DVD 
subpicture bitstream is extracted and coupled to DVD 
subpicture decoder 1514 and decoded at step 304. At step 
306, the DVD decoded subpicture information is processed 
starting with the base PID of the subpicture information. 
The subpicture information processing is only performed 
when either the user has selected data channel information 
to be displayed simultaneously with the MPEG video as an 
overlay or the user has tuned to a channel that contains- 
only DVD subpicture information to form an interactive < r~ 
session. The processed DVD subpicture information is 
stored at step 308 in frame buffer 1514. Generally only 
the necessary DVD subpicture information is stored and 
other information will be decoded and stored as needed. At 
step 310, the processed DVD subpicture information is 
displayed. 

At step 312, the user may interact with the DVD 
subpicture information by selecting a hot region within the 
display. A hot region is a highlighted region that can be 
"browsed" by manipulation of a remote control. In a 
conventional DVD, the selection of a hot region causes a 
mapping function to be invoked that connects the selection 
event with a sector location on the DVD. The imagery 
starting at the sector is then decoded and displayed. The 
present "invention invokes an analogous process when a hot 
region is selected to identify a location either in frame 
buffer 1514 or in the MPEG stream for the beginning of a 
selected DVD subpicture bitstream. At step 314, a pointer 
is mapped to a location within the bitstream that 
corresponds to the DVD subpicture information that will 
represent the information for the selected hot region. 

At step 316, method 300. queries whether that 
information is already buffered within frame buffer 1514. 
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If the query at step 316 is affirmatively answered, method 
300 proceeds to step 318 where the buffer location is found 
for the beginning of the bitstream corresponding to that 
hot region. Method 300 then proceeds to step 310 to 
display that DVD subpicture information. If the location 
is not buffered, method 300 proceeds from step 316 to step 
320 to wait for the appropriate location within the DVD 
subpicture bitstream to be decoded and then method 300 
returns to step 304 to decode the bitstream starting with 
the beginning of the portion that is selected. In this 
manner, the DVD subpicture information does not have to be 
completely buffered. As such, the interactive DVD menu 
structure can be used for navigating through a number of - 
menus and also selecting programming for display to. the 
user . 

Although an embodiment that incorporates the 
teachings of the present invention has been shown and 
described, it is to be understood that those skilled in the 
art may devise varied embodiments that still incorporate 
these teachings. For example, although the various decoder 
units are illustrated to be separate units, it is to be 
understood that the decoders may be incorporated within a 
single integrated circuit. Therefore, it is to be 
understood that the present invention is intended to cover 
all modifications as would fall within the true scope and 
spirit of the present invention. 
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